Multiple models for outbreak decision support in the face of uncertainty.

Policymakers must make management decisions despite incomplete knowledge and conflicting model projections. Little guidance exists for the rapid, representative, and unbiased collection of policy-relevant scientific input from independent modeling teams. Integrating approaches from decision analysis, expert judgment, and model aggregation, we convened multiple modeling teams to evaluate COVID-19 reopening strategies for a mid-sized United States county early in the pandemic. Projections from seventeen distinct models were inconsistent in magnitude but highly consistent in ranking interventions. The 6-mo-ahead aggregate projections were well in line with observed outbreaks in mid-sized US counties. The aggregate results showed that up to half the population could be infected with full workplace reopening, while workplace restrictions reduced median cumulative infections by 82%. Rankings of interventions were consistent across public health objectives, but there was a strong trade-off between public health outcomes and duration of workplace closures, and no win-win intermediate reopening strategies were identified. Between-model variation was high; the aggregate results thus provide valuable risk quantification for decision making. This approach can be applied to the evaluation of management interventions in any setting where models are used to inform decision making. This case study demonstrated the utility of our approach and was one of several multimodel efforts that laid the groundwork for the COVID-19 Scenario Modeling Hub, which has provided multiple rounds of real-time scenario projections for situational awareness and decision making to the Centers for Disease Control and Prevention since December 2020.

The changing health impact of vaccines in the COVID-19 pandemic: a modeling study

Much of the world's population had already been infected with COVID-19 by the time that the Omicron variant emerged at the end of 2021, but the scale of the Omicron wave was larger than any that had come before or since, and it left a global imprinting of immunity which changed the COVID-19 landscape. In this study, we simulate a South African population, and demonstrate how population-level vaccine effectiveness and efficiency changed over the course of the first two years of the pandemic. We then introduce three hypothetical variants and evaluate the impact of vaccines with different properties. We find that variant-chasing vaccines have a narrow window of dominating pre-existing vaccines, but that a variant-chasing vaccine strategy may have global utility, depending on the rate of spread from setting to setting. Next-generation vaccines might be able to overcome uncertainty in pace and degree of viral evolution. Graphical Cohen et al. conduct a model-based analysis of the health impact of COVID-19 vaccination in the context of viral evolution. Cohen et al. find variant-chasing vaccines have a narrow window of dominating pre-existing vaccines and next-generation vaccines might be able to overcome uncertainty in pace and degree of viral evolution.

The changing health impact of vaccines in the COVID-19 pandemic: A modeling study.

Much of the world's population had already been infected with COVID-19 by the time the Omicron variant emerged at the end of 2021, but the scale of the Omicron wave was larger than any that had come before or has happened since, and it left a global imprinting of immunity that changed the COVID-19 landscape. In this study, we simulate a South African population and demonstrate how population-level vaccine effectiveness and efficiency changed over the course of the first 2 years of the pandemic. We then introduce three hypothetical variants and evaluate the impact of vaccines with different properties. We find that variant-chasing vaccines have a narrow window of dominating pre-existing vaccines but that a variant-chasing vaccine strategy may have global utility, depending on the rate of spread from setting to setting. Next-generation vaccines might be able to overcome uncertainty in pace and degree of viral evolution.

Frequent and unpredictable changes in COVID-19 policies and restrictions reduce the accuracy of model forecasts.

Between June and August 2020, an agent-based model was used to project rates of COVID-19 infection incidence and cases diagnosed as positive from 15 September to 31 October 2020 for 72 geographic settings. Five scenarios were modelled: a baseline scenario where no future changes were made to existing restrictions, and four scenarios representing small or moderate changes in restrictions at two intervals. Post hoc, upper and lower bounds for number of diagnosed Covid-19 cases were compared with actual data collected during the prediction window. A regression analysis with 17 covariates was performed to determine correlates of accurate projections. It was found that the actual data fell within the lower and upper bounds in 27 settings and out of bounds in 45 settings. The only statistically significant predictor of actual data within the predicted bounds was correct assumptions about future policy changes (OR 15.04; 95% CI 2.20-208.70; p = 0.016). Frequent changes in restrictions implemented by governments, which the modelling team was not always able to predict, in part explains why the majority of model projections were inaccurate compared with actual outcomes and supports revision of projections when policies are changed as well as the importance of modelling teams collaborating with policy experts.

Modelling herd immunity requirements in Queensland: impact of vaccination effectiveness, hesitancy and variants of SARS-CoV-2.

Long-term control of SARS-CoV-2 outbreaks depends on the widespread coverage of effective vaccines. In Australia, two-dose vaccination coverage of above 90% of the adult population was achieved. However, between August 2020 and August 2021, hesitancy fluctuated dramatically. This raised the question of whether settings with low naturally derived immunity, such as Queensland where less than [Formula: see text] of the population is known to have been infected in 2020, could have achieved herd immunity against 2021's variants of concern. To address this question, we used the agent-based model Covasim. We simulated outbreak scenarios (with the Alpha, Delta and Omicron variants) and assumed ongoing interventions (testing, tracing, isolation and quarantine). We modelled vaccination using two approaches with different levels of realism. Hesitancy was modelled using Australian survey data. We found that with a vaccine effectiveness against infection of 80%, it was possible to control outbreaks of Alpha, but not Delta or Omicron. With 90% effectiveness, Delta outbreaks may have been preventable, but not Omicron outbreaks. We also estimated that a decrease in hesitancy from 20% to 14% reduced the number of infections, hospitalizations and deaths by over 30%. Overall, we demonstrate that while herd immunity may not be attainable, modest reductions in hesitancy and increases in vaccine uptake may greatly improve health outcomes. This article is part of the theme issue 'Technical challenges of modelling real-life epidemics and examples of overcoming these'.

Impact of SARS-CoV-2 Gamma lineage introduction and COVID-19 vaccination on the epidemiological landscape of a Brazilian city.

Background: The emergence of the Brazilian variant of concern, Gamma lineage (P.1), impacted the epidemiological profile of COVID-19 cases due to its higher transmissibility rate and immune evasion ability. Methods: We sequenced 305 SARS-CoV-2 whole-genomes and performed phylogenetic analyses to identify introduction events and the circulating lineages. Additionally, we use epidemiological data of COVID-19 cases, severe cases, and deaths to measure the impact of vaccination coverage and mortality risk. Results: Here we show that Gamma introduction in São José do Rio Preto, São Paulo, Brazil, was followed by the displacement of seven circulating SARS-CoV-2 variants and a rapid increase in prevalence two months after its first detection in January 2021. Moreover, Gamma variant is associated with increased mortality risk and severity of COVID-19 cases in younger age groups, which corresponds to the unvaccinated population at the time. Conclusions: Our findings highlight the beneficial effects of vaccination indicated by a pronounced reduction of severe cases and deaths in immunized individuals, reinforcing the need for rapid and massive vaccination.

Risk of sustained SARS-CoV-2 transmission in Queensland, Australia.

We used an agent-based model Covasim to assess the risk of sustained community transmission of SARSCoV-2/COVID-19 in Queensland (Australia) in the presence of high-transmission variants of the virus. The model was calibrated using the demographics, policies, and interventions implemented in the state. Then, using the calibrated model, we simulated possible epidemic trajectories that could eventuate due to leakage of infected cases with high-transmission variants, during a period without recorded cases of locally acquired infections, known in Australian settings as "zero community transmission". We also examined how the threat of new variants reduces given a range of vaccination levels. Specifically, the model calibration covered the first-wave period from early March 2020 to May 2020. Predicted epidemic trajectories were simulated from early February 2021 to late March 2021. Our simulations showed that one infected agent with the ancestral (A.2.2) variant has a 14% chance of crossing a threshold of sustained community transmission (SCT) (i.e., > 5 infections per day, more than 3 days in a row), assuming no change in the prevailing preventative and counteracting policies. However, one agent carrying the alpha (B.1.1.7) variant has a 43% chance of crossing the same threshold; a threefold increase with respect to the ancestral strain; while, one agent carrying the delta (B.1.617.2) variant has a 60% chance of the same threshold, a fourfold increase with respect to the ancestral strain. The delta variant is 50% more likely to trigger SCT than the alpha variant. Doubling the average number of daily tests from ∼ 6,000 to 12,000 results in a decrease of this SCT probability from 43 to 33% for the alpha variant. However, if the delta variant is circulating we would need an average of 100,000 daily tests to achieve a similar decrease in SCT risk. Further, achieving a full-vaccination coverage of 70% of the adult population, with a vaccine with 70% effectiveness against infection, would decrease the probability of SCT from a single seed of alpha from 43 to 20%, on par with the ancestral strain in a naive population. In contrast, for the same vaccine coverage and same effectiveness, the probability of SCT from a single seed of delta would decrease from 62 to 48%, a risk slightly above the alpha variant in a naive population. Our results demonstrate that the introduction of even a small number of people infected with high-transmission variants dramatically increases the probability of sustained community transmission in Queensland. Until very high vaccine coverage is achieved, a swift implementation of policies and interventions, together with high quarantine adherence rates, will be required to minimise the probability of sustained community transmission.

Preventing a cluster from becoming a new wave in settings with zero community COVID-19 cases.

BACKGROUND: In settings with zero community transmission, any new SARS-CoV-2 outbreaks are likely to be the result of random incursions. The level of restrictions in place at the time of the incursion is likely to considerably affect possible outbreak trajectories, but the probability that a large outbreak eventuates is not known. METHODS: We used an agent-based model to investigate the relationship between ongoing restrictions and behavioural factors, and the probability of an incursion causing an outbreak and the resulting growth rate. We applied our model to the state of Victoria, Australia, which has reached zero community transmission as of November 2020. RESULTS: We found that a future incursion has a 45% probability of causing an outbreak (defined as a 7-day average of > 5 new cases per day within 60 days) if no restrictions were in place, decreasing to 23% with a mandatory masks policy, density restrictions on venues such as restaurants, and if employees worked from home where possible. A drop in community symptomatic testing rates was associated with up to a 10-percentage point increase in outbreak probability, highlighting the importance of maintaining high testing rates as part of a suppression strategy. CONCLUSIONS: Because the chance of an incursion occurring is closely related to border controls, outbreak risk management strategies require an integrated approaching spanning border controls, ongoing restrictions, and plans for response. Each individual restriction or control strategy reduces the risk of an outbreak. They can be traded off against each other, but if too many are removed there is a danger of accumulating an unsafe level of risk. The outbreak probabilities estimated in this study are of particular relevance in assessing the downstream risks associated with increased international travel.

Covasim: An agent-based model of COVID-19 dynamics and interventions.

The COVID-19 pandemic has created an urgent need for models that can project epidemic trends, explore intervention scenarios, and estimate resource needs. Here we describe the methodology of Covasim (COVID-19 Agent-based Simulator), an open-source model developed to help address these questions. Covasim includes country-specific demographic information on age structure and population size; realistic transmission networks in different social layers, including households, schools, workplaces, long-term care facilities, and communities; age-specific disease outcomes; and intrahost viral dynamics, including viral-load-based transmissibility. Covasim also supports an extensive set of interventions, including non-pharmaceutical interventions, such as physical distancing and protective equipment; pharmaceutical interventions, including vaccination; and testing interventions, such as symptomatic and asymptomatic testing, isolation, contact tracing, and quarantine. These interventions can incorporate the effects of delays, loss-to-follow-up, micro-targeting, and other factors. Implemented in pure Python, Covasim has been designed with equal emphasis on performance, ease of use, and flexibility: realistic and highly customized scenarios can be run on a standard laptop in under a minute. In collaboration with local health agencies and policymakers, Covasim has already been applied to examine epidemic dynamics and inform policy decisions in more than a dozen countries in Africa, Asia-Pacific, Europe, and North America.

Estimating and mitigating the risk of COVID-19 epidemic rebound associated with reopening of international borders in Vietnam: a modelling study.

BACKGROUND: Vietnam has emerged as one of the world's leading success stories in responding to COVID-19. After a prolonged period of little to no transmission, there was an outbreak of unknown source in July, 2020, in the Da Nang region, but the outbreak was quickly suppressed. We aimed to use epidemiological, behavioural, demographic, and policy data from the COVID-19 outbreak in Da Nang to calibrate an agent-based model of COVID-19 transmission for Vietnam, and to estimate the risk of future outbreaks associated with reopening of international borders in the country. METHODS: For this modelling study, we used comprehensive data from June 15 to Oct 15, 2020, on testing, COVID-19 cases, and quarantine breaches within an agent-based model of SARS-CoV-2 transmission to model a COVID-19 outbreak in Da Nang in July, 2020. We applied this model to quantify the risk of future outbreaks in Vietnam in the 3 months after the reopening of international borders, under different behavioural scenarios, policy responses (ie, closure of workplaces and schools), and ongoing testing. FINDINGS: We estimated that the outbreak in Da Nang between July and August, 2020, resulted in substantial community transmission, and that higher levels of symptomatic testing could have mitigated this transmission. We estimated that the outbreak peaked on Aug 2, 2020, with an estimated 1060 active infections (95% projection interval 890-1280). If the population of Vietnam remains highly compliant with mask-wearing policies, our projections indicate that the epidemic would remain under control even if a small but steady flow of imported infections escaped quarantine into the community. However, if complacency increases and testing rates are relatively low (10% of symptomatic individuals are tested), the epidemic could rebound again, resulting in an estimated 2100 infections (95% projected interval 1050-3610) in 3 months. These outcomes could be mitigated if the behaviour of the general population responds dynamically to increases in locally acquired cases that exceed specific thresholds, but only if testing of symptomatic individuals is also increased. INTERPRETATION: The successful response to COVID-19 in Vietnam could be improved even further with higher levels of symptomatic testing. If the previous approaches are used in response to new COVID-19 outbreaks, epidemic control is possible even in the presence of low levels of imported cases. FUNDING: Ministry of Science and Technology (Vietnam). TRANSLATION: For the Vietnamese translation of the abstract see Supplementary Materials section.

Controlling COVID-19 via test-trace-quarantine.

Initial COVID-19 containment in the United States focused on limiting mobility, including school and workplace closures. However, these interventions have had enormous societal and economic costs. Here, we demonstrate the feasibility of an alternative control strategy, test-trace-quarantine: routine testing of primarily symptomatic individuals, tracing and testing their known contacts, and placing their contacts in quarantine. We perform this analysis using Covasim, an open-source agent-based model, which has been calibrated to detailed demographic, mobility, and epidemiological data for the Seattle region from January through June 2020. With current levels of mask use and schools remaining closed, we find that high but achievable levels of testing and tracing are sufficient to maintain epidemic control even under a return to full workplace and community mobility and with low vaccine coverage. The easing of mobility restrictions in June 2020 and subsequent scale-up of testing and tracing programs through September provided real-world validation of our predictions. Although we show that test-trace-quarantine can control the epidemic in both theory and practice, its success is contingent on high testing and tracing rates, high quarantine compliance, relatively short testing and tracing delays, and moderate to high mask use. Thus, in order for test-trace-quarantine to control transmission with a return to high mobility, strong performance in all aspects of the program is required.

Role of masks, testing and contact tracing in preventing COVID-19 resurgences: a case study from New South Wales, Australia.

OBJECTIVES: The early stages of the COVID-19 pandemic illustrated that SARS-CoV-2, the virus that causes the disease, has the potential to spread exponentially. Therefore, as long as a substantial proportion of the population remains susceptible to infection, the potential for new epidemic waves persists even in settings with low numbers of active COVID-19 infections, unless sufficient countermeasures are in place. We aim to quantify vulnerability to resurgences in COVID-19 transmission under variations in the levels of testing, tracing and mask usage. SETTING: The Australian state of New South Wales (NSW), a setting with prolonged low transmission, high mobility, non-universal mask usage and a well-functioning test-and-trace system. PARTICIPANTS: None (simulation study). RESULTS: We find that the relative impact of masks is greatest when testing and tracing rates are lower and vice versa. Scenarios with very high testing rates (90% of people with symptoms, plus 90% of people with a known history of contact with a confirmed case) were estimated to lead to a robustly controlled epidemic. However, across comparable levels of mask uptake and contact tracing, the number of infections over this period was projected to be 2-3 times higher if the testing rate was 80% instead of 90%, 8-12 times higher if the testing rate was 65% or 30-50 times higher with a 50% testing rate. In reality, NSW diagnosed 254 locally acquired cases over this period, an outcome that had a moderate probability in the model (10%-18%) assuming low mask uptake (0%-25%), even in the presence of extremely high testing (90%) and near-perfect community contact tracing (75%-100%), and a considerably higher probability if testing or tracing were at lower levels. CONCLUSIONS: Our work suggests that testing, tracing and masks can all be effective means of controlling transmission. A multifaceted strategy that combines all three, alongside continued hygiene and distancing protocols, is likely to be the most robust means of controlling transmission of SARS-CoV-2.

Modelling the impact of relaxing COVID-19 control measures during a period of low viral transmission.

OBJECTIVES: To assess the risks associated with relaxing coronavirus disease 2019 (COVID-19)-related physical distancing restrictions and lockdown policies during a period of low viral transmission. DESIGN: Network-based viral transmission risks in households, schools, workplaces, and a variety of community spaces and activities were simulated in an agent-based model, Covasim. SETTING: The model was calibrated for a baseline scenario reflecting the epidemiological and policy environment in Victoria during March-May 2020, a period of low community viral transmission. INTERVENTION: Policy changes for easing COVID-19-related restrictions from May 2020 were simulated in the context of interventions that included testing, contact tracing (including with a smartphone app), and quarantine. MAIN OUTCOME MEASURE: Increase in detected COVID-19 cases following relaxation of restrictions. RESULTS: Policy changes that facilitate contact of individuals with large numbers of unknown people (eg, opening bars, increased public transport use) were associated with the greatest risk of COVID-19 case numbers increasing; changes leading to smaller, structured gatherings with known contacts (eg, small social gatherings, opening schools) were associated with lower risks. In our model, the rise in case numbers following some policy changes was notable only two months after their implementation. CONCLUSIONS: Removing several COVID-19-related restrictions within a short period of time should be undertaken with care, as the consequences may not be apparent for more than two months. Our findings support continuation of work from home policies (to reduce public transport use) and strategies that mitigate the risk associated with re-opening of social venues.

Determining the optimal strategy for reopening schools, the impact of test and trace interventions, and the risk of occurrence of a second COVID-19 epidemic wave in the UK: a modelling study.

BACKGROUND: As lockdown measures to slow the spread of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection begin to ease in the UK, it is important to assess the impact of any changes in policy, including school reopening and broader relaxation of physical distancing measures. We aimed to use an individual-based model to predict the impact of two possible strategies for reopening schools to all students in the UK from September, 2020, in combination with different assumptions about relaxation of physical distancing measures and the scale-up of testing. METHODS: In this modelling study, we used Covasim, a stochastic individual-based model for transmission of SARS-CoV-2, calibrated to the UK epidemic. The model describes individuals' contact networks stratified into household, school, workplace, and community layers, and uses demographic and epidemiological data from the UK. We simulated six different scenarios, representing the combination of two school reopening strategies (full time and a part-time rota system with 50% of students attending school on alternate weeks) and three testing scenarios (68% contact tracing with no scale-up in testing, 68% contact tracing with sufficient testing to avoid a second COVID-19 wave, and 40% contact tracing with sufficient testing to avoid a second COVID-19 wave). We estimated the number of new infections, cases, and deaths, as well as the effective reproduction number (R) under different strategies. In a sensitivity analysis to account for uncertainties within the stochastic simulation, we also simulated infectiousness of children and young adults aged younger than 20 years at 50% relative to older ages (20 years and older). FINDINGS: With increased levels of testing (between 59% and 87% of symptomatic people tested at some point during an active SARS-CoV-2 infection, depending on the scenario), and effective contact tracing and isolation, an epidemic rebound might be prevented. Assuming 68% of contacts could be traced, we estimate that 75% of individuals with symptomatic infection would need to be tested and positive cases isolated if schools return full-time in September, or 65% if a part-time rota system were used. If only 40% of contacts could be traced, these figures would increase to 87% and 75%, respectively. However, without these levels of testing and contact tracing, reopening of schools together with gradual relaxing of the lockdown measures are likely to induce a second wave that would peak in December, 2020, if schools open full-time in September, and in February, 2021, if a part-time rota system were adopted. In either case, the second wave would result in R rising above 1 and a resulting second wave of infections 2·0-2·3 times the size of the original COVID-19 wave. When infectiousness of children and young adults was varied from 100% to 50% of that of older ages, we still found that a comprehensive and effective test-trace-isolate strategy would be required to avoid a second COVID-19 wave. INTERPRETATION: To prevent a second COVID-19 wave, relaxation of physical distancing, including reopening of schools, in the UK must be accompanied by large-scale, population-wide testing of symptomatic individuals and effective tracing of their contacts, followed by isolation of diagnosed individuals. FUNDING: None.